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earned patent term adjustment. See 37 CFR 1.704(b). 
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DETAILED ACTION 

1 . The response received on 1 1 April 2005 has been placed in the file and was considered by the examiner. 
An action on the merits follows. 

Response to Arguments 

2. The arguments filed on 1 1 April 2005 have been fully considered. A response to these arguments is 
provided below. 

Prior Art Rejections 

Summary of Argument : 

1 . In the previous rejection, the examiner argued that there was an "inherently tight nexus between display 
devices and gradation conversion curves " The examiner provided the Sato reference — not to cure a deficiency in 
the rejection — but merely to illustrate the concept of the gradation conversion curve. Applicant now argues that 
there is not an inherently tight nexus between display devices and gradation conversion curves (see remarks pg. 10). 
It appears as if the applicant has formed this opinion after reading the provided Sato reference. 

2. Applicant argues that none of Tokuyama, Takagi, Pollard, Katsuyama, or Kuo teach the limitation of 
"correcting luminance by raising the contrast of the image on the basis of estimated contrast and correcting 
luminance of the pixels constituting the image based on the predetermined gradation characteristics of the display 
means." 

Examiner f s Response : 

1. Display devices have inherent gradation characteristics. For example, an older computer display device 
might represent pixels with 4-bit words, while more recent displays might use 32-bit words. Obviously, the larger 
bit words are able to represent more shades than the smaller bit words. The gradation characteristic can either be 
defined as the number of bits used per pixel, or the number of different shades that the pixel can take on. Either 
way, this is an inherent part of the device because it determines the number of tones that can be displayed. 

A gradation conversion (i.e. gradation conversion curve, from which a gradation look-up table would be 
derived) occurs for instance when an analog signal such as a video signal is processed with a digital circuit (such as 
is in a computer) for viewing. In such a case, the image is displayed with a predetermined (i.e. determined by the 
gradation characteristics of the display device — see the above paragraph) number of gradations. A gradation 
conversion simply converts an input signal into a digital signal having a number of resolution levels that can be 
displayed by the display device. Accordingly, this gradation conversion is dependent on the gradation 
characteristics of the display device. Applicant's statement that "the converted analog signal is nothing more than 
gradation levels for RGB and is totally unrelated to the gradation characteristics of the display device" isn't just 
unpersuasive; its incorrect. Furthermore, since this argument is directed at a reference that was not actually used in 
the rejection, it isn't particularly pertinent to the prosecution. 
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2. Applicant's arguments are directed to a limitation not recited in the claims. It does not appear as if any of 
the instant claims recite the limitation of 'raising image contrast. Consequently, the arguments are moot. 



Claim Rejections - 35 USC §102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the 
rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

4. Claims 1 and 9 are rejected under 35 U.S.C. 102(b) as being anticipated by Shiraiwa (US Patent 
6,201,893). 

With respect to claim 1, which is representative of claim 9, Shiraiwa discloses a display means with 
predetermined gradation characteristics (column 3, line 54 and element 40 of Figure 1). Although predetermined 
gradation characteristics are not explicitly disclosed in Shiraiwa, it is well known in the art that display devices are 
inherently associated with predetermined gradation characteristics. 

Shiraiwa also discloses an image input means for inputting an image composed of pixels (column 3, line 
52). The color image pickup unit (element 10 of Figure 1) disclosed in Shiraiwa is analogous to an input means as 
stated in the application. 

Shiraiwa discloses a contrast estimation means (discussed in the below paragraph). 

Shiraiwa further discloses a luminance correction means. The 'image reproduction processing section' 
(element 35) is analogous to the claimed luminace correction means (Shiraiwa col. 8 lines 12-16: The reference 
describes using 'separately determined image reproduction parameters' to determine one specific image 
reproduction parameter, and then processing the image based on this parameter). Thus, Shiraiwa clearly discloses 
performing luminance correction (e.g. white balance adjustment, as disclosed at col. 5 lines 27-28). Shiraiwa also 
clearly discloses that the luminance corrrection means is based on estimated contrast (e.g. the intensity distribution, 
or the wiener spectrum (which is a measurement of noise power density which requires a contrast estimate for its 
determination), or the color range (another estimate of contrast), etc.) (col. 4 lines 20-34). Shiraiwa also clearly 
discloses that the luminance correction means is based on gradation characteristics (col. 4 lines 25-27: The 
reference describes a 'gradation characteristic', a 'gradation conversion curve', and a 'gradation conversion look up 
table'). These gradation characteristics are associated with a display device, as is discussed in the above response to 
arguments. 

Shiraiwa also discloses that said display means display an image that has been corrected by said luminance 
correction means (column 4 lines 48-51). 



Claim Rejections - 35 USC § 103 
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5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set 

forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 1 1 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable over Shiraiwa in view of Kuo 
(US Patent 5,982,926). The arguments as to the relevance of Shiraiwa in paragraph 2 are incorporated herein. 

With regard to claim 1 1, which is representative of claim 12, Shiraiwa discloses a contrast estimation 
means for estimating contrast of an input image and a luminance correction means for raising the contrast of an 
input image. Shiraiwa does not define the contrast in terms of a luminance corresponding to lines and dots in the 
image and a luminance corresponding to the background of the image. Shiraiwa also fails to expressly disclose that 
the contrast of the image is raised to a maximum contrast corresponding to a lower limit of luminance (Vmin) and 
an upper limit of luminance (Vmax). 

Kuo defines the contrast of the input image in terms of luminance components ymin and ybkg 
([ymin,ybkg]) (column 9 line 38). Luminance term ymin corresponds to the foreground of a textual image 
document (column 9, lines 29-30 and column 9, line 1 1). The foreground of a textual image document as disclosed 
in Kuo is analogous to lines and dots generated in the input image as stated in the application and luminance term 
ymin from Kuo is analogous to Lv as stated in the application. Luminance term ybkg corresponds to the 
background of an image (column 9, lines 19-21) and is analogous to luminance term Hv as stated in the application. 

Kuo further discloses enhancing the contrast of the image by mapping the luminance component from 
[ymin,ybkg] to [YMIN,YMAX], where YMIN and YMAX are, respectively, the minimum and maximum Y values 
of available luminances (column 9, lines 37-41). The term [YMIN, YMAX] disclosed in Kuo is analogous to 
[VMIN, VMAX] as stated in the application. The idea of enhancing contrast by mapping luminance components as 
disclosed in Kuo is analogous to raising the contrast as stated in the application. 

It would have been obvious at the time of the invention to modify Shiraiwa' s contrast estimation and 
luminance correction means by defining contrast of an image in terms of two luminance terms and mapping those 
luminance terms to minimum and maximum levels in order to enhance the contrast of the image. Such a 
modification would have allowed for a method that effectively removes blurring from an image and maximizes 
contrast (Kuo column 9, lines 57-58). It also would have allowed for a contrast enhancing method that utilized the 
full range of luminance values (Kuo column 8, lines 56-57). 

7. Claims 2, 6, 8 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Shiraiwa (US Patent 
6,20 1,893) in view of Tokuyama (US Patent 6,240,206). The arguments as to the relevance of Shiraiwa in 
paragraph 2 are incorporated herein. 
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With regard to claim 2, which is representative of claim 10, Shiraiwa discloses a display means having 
predetermined gradation characteristics, an image input means for inputting an image composed of a plurality of 
pixels and a luminance correction means that corrects the luminance of pixels constituting an image based on 
gradation characteristics. Shiraiwa additionally discloses that said display means displays the image in which the 
luminance of each of the pixels has been corrected by the luminance correction means. Shiraiwa does not disclose a 
character region extraction means or a sharpening means. 

Tokuyama discloses a character region extracting means for extracting character regions from an image 
(column 2, lines 20-28). The region separating section (element 12, Figure 1) as disclosed in Tokuyama is 
analogous to a region extracting means as stated in the application. 

Tokuyama discloses carrying out sharpening for the character region at a sharpening level higher than the 
level of sharpening performed for the remaining regions (Tokuyama col. 1 1 line 37 - col. 12 line 16 in conjunction 
with Figure 10). This occurs in the event that the value of XB is between 0 and -25000, the value of XA is between 
0 and 50000, and the value of XC is between 0 and 25000. In this situation, the photographic and spot regions 
(which correspond to XA and XC, respectively) are filtered at one of the predetermined sharpening levels shown in 
Figures 1 l(a)-(i) and the character region (which corresponds to XB) is filtered at a sharpening level higher than the 
other regions. The degree of enhancement as disclosed in Shiraiwa is analogous to the level of sharpening recited in 
the claim. 

It would have been obvious to one reasonably skilled in the art at the time of the invention to modify the 
image processing system of Shiraiwa to include character region extraction means and sharpening means for 
sharpening character regions at a higher level than non-character regions as taught by Tokuyama. Such a 
modification would have allowed, for an image processing apparatus capable of improving the quality of an image 
comprised of character regions and non-character regions. 

With regard to claim 6, Shiraiwa discloses contrast correction means for raising the contrast of the image 
on the basis of estimated contrast (Shiraiwa column 6 lines 53-59). Shiraiwa discloses performing luminance 
distribution smoothing processing on an image on the basis of its contrast. Luminance distribution smoothing is a 
method well known in the art for enhancing the contrast of an image. Enhancing the contrast of an image is 
analogous to raising the contrast of an image or lowering it as needed based on the histogram of luminance levels 
(column 6 lines 57-58). Said luminance distribution smoothing determines image reproduction parameters for pixel 
luminance. Said parameters, which are held in the image reproduction parameter determination section (element 32 
of Figure 1), are then used by the image reproduction processing section (element 35 of Figure 1) to produce image 
data. As a result, the combination of the parameter determination section and the processing section as disclosed in 
Shiraiwa is analogous to contrast correction means as stated in the application 

With regards to claim 8, the combination of Shiraiwa and Tokuyama discloses a system comprised of 
character region extracting means, sharpening means and luminance correction means. Shiraiwa further discloses 
performing image reproduction processing on an image where the pixels are represented by three color components 
(Shiraiwa column 3, lines 65-68 with column 4 lines 1-19). Shiraiwa discloses performing image reproduction 
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processing on digital RGB data, which is analogous to a case where luminance is represented by the sum of 
predetermined three color components as stated in the application. 

8. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Shiraiwa and 
Tokuyama as applied to claims 2, 6, 8 and 10 above, and further in view of Takagi ("Selective Image Sharpening", 
Image Analysis Handbook. University of Tokyo Press January 17 1991, page 549). 

The combination of Shiraiwa and Tokuyama discloses a sharpening means, but fails to disclose the exact 
formula that the sharpening means uses in order to correct luminance values in both character and non-character 
regions. Takagi discloses the exact formula utilized by the sharpening means to obtain luminance values as stated in 
the application. 

It would have been obvious to one reasonably skilled in the art at the time of the invention to modify the 
image processing system disclosed in the combination of Shiraiwa and Tokuyama by including the selective 
sharpening method disclosed in Takagi. Such a modification would have allowed for the use of a method well 
known in the art in order to implement the selective sharpening of character and non-character regions. Said method 
could be easily implemented because of the ease with which the transition is made between the sharpening of 
character regions and the sharpening of non-character regions. 

9. Claims 4 and 5 are rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Shiraiwa 
and Tokuyama as applied to claim 2 above, and further in view of Pollard (US Patent 6,266,439) and Katsuyama 
(US Patent 6,035,061). The arguments as to the relevance of the combination of Shiraiwa and Tokuyama in 
paragraph 5 are incorporated herein. 

With regards to claim 4, Tokuyama further discloses a character region extracting means that extracts a 
region in which the difference between the maximum value and minimum value of luminance of the plurality of 
pixels in the respective regions is not less than a reference difference value (column 5 lines 6-28,44-5 1). A block as 
disclosed in Tokuyama is analogous to a region containing a plurality of pixels as stated in the application. The 
(maximum value - minimum value) operation from Tokuyama gives a feature parameter Pa which is then compared 
to the region separation tables in Figure 13. These tables are analogous to a reference difference value as stated in 
the application. The combination of Shiraiwa and Tokuyama does not expressly disclose converting the luminance 
values of pixels into binary form, obtaining blocks of pixels having equal binary-coded luminance or obtaining 
rectangles circumscribing blocks of connected pixels. Pollard discloses converting the pixels of the image into 
binary form (column 4 lines 56-62). The process of snapping some pixels to white and snapping other pixels to 
black as disclosed in Pollard is analogous to converting the pixels into binary form as stated in the application. 
Pollard also discloses obtaining blocks of connected pixels with the same luminance (column 9, lines 18-22). The 
contiguous runs disclosed in Pollard are analogous to blocks of connected pixels as stated in the application. The 
appropriately labeled status pixels disclosed in Pollard are grouped according to luminance classification and are 



Application/Control Number: 09/600,936 
Art Unit: 2621 



Page 7 



therefore analogous to having the same luminance level as stated in the application. Katsuyama discloses 
integrating circumscribed rectangles overlapping one another into a single circumscribed rectangle (column 1 1, lines 
43-48 in conjunction with Figure 15). The unification of rectangles that overlap as disclosed in Katsuyama is 
analogous to integrating the rectangles as disclosed in the application. 

With regards to claim 5, Katsuyama additionally discloses extracting regions in nearly parallel with a 
predetermined axis line as character regions (column 28 lines 49-58). The table ruled lines as disclosed in 
Katsuyama are analogous to predetermined reference axis lines that arrange regions in parallel as stated in the 
application. 

It would have been obvious to one reasonably skilled in the art at the time of the invention to modify the 
combination of Shiraiwa and Tokuyama by including the binary conversion of pixel values and the grouping 
together of pixels with the same luminance as taught by Pollard and the integration of circumscribed rectangles and 
the arrangement of character regions in parallel with a reference axis line as taught by Katsuyama. Such a 
modification would have allowed for a system of efficiently extracting characters from character regions in an 
image. 

10. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Shiraiwa and 
Tokuyama as applied to claim 6 above, and further in view of Yamazaki (US Patent 5,801,791). The arguments as 
to the relevance of the combination of Shiraiwa and Tokuyama as applied in paragraph 5 are incorporated herein. 
The combination of Shiraiwa and Tokuyama discloses contrast estimation means that generate a histogram of pixel 
luminance for an image. It does not disclose estimating contrast by splitting the histogram into two ranges and 
comparing maximum luminance values of the ranges to predetermined reference values. Yamazaki discloses 
splitting a histogram into two ranges based on the average brightness of the input data (column 2 lines 46-51). 
Yamazaki further discloses using a maximum value and a minimum value from the ranges in order to estimate 
contrast (column 2 lines 18-31,51-54). 

It would have been obvious to one reasonably skilled in the art at the time of the invention to modify the 
combination of Shiraiwa and Tokuyama by including contrast estimation means that split a luminance histogram 
into two ranges and find maximum and minimum values from those ranges. Such a modification would have 
allowed for a way to display the character regions of an image with a clear outline. (Y amazaki column 1 lines 53- 
54). 

Conclusion 

1 1 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 
37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final 
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action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, 
then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee 
pursuant to 37 CFR 1. 136(a) will be calculated from the mailing date of the advisory action, In no event, however, 
will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action. 

12. The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. 

■ Doihara et al. (USPN 6,486,863) is pertinent because it further illustrates that gradation characteristics 
are inherent in computer display devices 

■ "The photographs don't look good! What's wrong?" also illustrates the inherency of gradation 
characteristics. 

13. Any inquiry concerning this communication or earlier communications from the examiner should be 
directed to Patrick L Edwards whose telephone number is (571) 272-7390. The examiner can normally be reached 
on 8:30am -5:00pm M-F. 

If attempts to reach the examiner. by telephone are unsuccessful, the examiner's supervisor, Joe Mancuso 
can be reached on (571) 272-7695. The fax phone number for the organization where this application or proceeding 
is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent Application Information 
Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR 
or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more 
information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the 
Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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